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ABSTRACT 

Past  and  current  replacement  models  with 
applications  to  the  marine  industry  for  de- 

termini ng  the  optimum  maintanance  stratefy 

are  discussed.  A  new  approach  to  multi-item 

replacement  under  budget  constraints  is  pre- 

sented.  This  approach  considers  all  replace¬ 
ment  decisions  of  an  entire  ship  fleet,  (or  all 
component  replacements  of  3  Single  ship)  si¬ 
multaneously.  A  Lagrangian  methodology  for 
the  replacement  problem  is  also  described. 

LIST  OF  ACRONYMS 

ARP  Age  Replacement  Policy 

IFR  Increasing  Failure  Rate 

MAM  Multiplier  Adjustment  Method 
MARP  Modified  Age  Replacement  Policy 
MTTF  Mean  time  To  Failure 
TTR  Time  To  Repair 

INTRODUCTION 

With  reduced  manning  ISVSlS  and  the  GVGf 
increasing  competition,  ship  maintenance  has 
become  one  of  the  major  problems  in  ma¬ 
rine  industry.  Optimization  of  maintenance 
and  replacement  is  very  challenging  dUG  tO 
highly  restrictive  and  harsh  operating  condi- 

tions  of  ships.  Moreover,  these  operating  con¬ 
ditions,  in  many  cases,  are  only  known  with 
a  high  level  of  uncertainty  which  makes  the 
optimization  problem  evenmore  complicated. 

However,  lowering  extremely  high  downtime 
costs  by  reducing  emergency  repairs  Caused 

by  insufficient  maintenance  practices  is  always 


desired,  in  the  mean  time,  there  is  a  deli- 

cate  tradeoff  between  the  cost  of  overmainte¬ 
nance  and  the  cost  of  avoided  maintenance 
in  keeping  the  shipping  company  competi¬ 
tive.  Hence,  the  maintenance  and  replace¬ 
ment  problem  in  the  marine  industry  has  con¬ 
flicting  multiple  objectives,  such  as  maximization- 

ing  reliability  and  safety  and  minimizing  costs 

simultenaously.  As  a  result,  optimization  of 

marine  maintenance  becomes  a  very  difficult 
and  complicated  problem  (19,20). 

Traditionally,  many  ship  operators  have 
been  trying  to  solve  maintenance  optimiza- 
tion  problem  based  on  "experience"  and 
"judgement"  of  managers  basically  using  con¬ 
servative  manufacture's  recommendations 
and  rules  of  thumb  (1,23).  However  Using 
scientific  techniques  as  opposed  to  ad  hoc 
methods  in  maintenance  optimization  has 
been  proved  to  be  very  rewarding  in  other 

industries  (18).  Naturally,  there  is  a  growing 

interest  for  just-in-time  for  maintenance  and  re- 
placement  management  in  the  marine  indus- 

try.  During  the  last  decade,  artificial  intelli¬ 
gence  methods  have  been  successfully  applied 
to  shipboard  monitoring,  container  stowage 

planning  (16,42),  spare  parts  inventory  man- 

agement(34),  and  marine  diesel  engine  fault 
diagnosis  (29.30,35).  I  Pi  the  mean  time,  the 
SpGGd,  storage  capability  and  flexibility  of 
computers  have  been  tremendously  improved 

during  the  last  decade.  At  the  same  time. 

the  use  of  computerized  database  systems 

for  maintenance  records  has  been  growing. 
Hence,  sophisticated  maintenance  models  will 
increasingly  become  applicable  as  more  data 
and  computing  capability  are  available. 
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In  this  paper,  first  past  and  current  main¬ 
tenance  and  replacement  with  appli¬ 
cations  in  the  marine  industry  are  discussed. 
Then,  a  new  approach  to  group  replacement 
under  budget  constraints  is  presented.  This 
approach  considers  all  replacement  decisions 
of  an  entire  ship  fleet  (or  all  component  re¬ 
placements  for  a  single  ship)  simultaneously. 
A  Lagrangian  methodology  for  the  replace¬ 
ment  problem  is  also  presented. 

MODELS 

Marine  maintenance  and  replacement  op¬ 
timization  has  conflicting  multiple  objectives. 
Simultaneous  optimization  of  these  objec¬ 
tives  can  be  achived  by  utilizing  interactive 
techniques  which  involve  the  decision  maker 
throughout  the  optimization  process.  A  com¬ 
prehensive  list,  of  papers  (1965-1988)  dealing 
with  interactive  multiple  objective  decision 
making  is  provided  by  Aksoy  (2). 

Maintenance  and  replacement  models  can 
be  classified  based  on  information  availabil¬ 
ity,  system  type  as  single  or  multi-unit,  time- 
event/action  relationship  relationship,  state-event/action 
relationship,  model  types,  optimality  crite¬ 
rion,  solution  methods,  planning  time  hori¬ 
zon.  Pierskalla  and  Voelker  (43)  surveyed 
maintenance  models  developed  until  1976. 
Then,  Sherif  and  smith(45)  classified  deter¬ 
ministic  and  stochastic  models  in  their  1981 
survey.  The  authors  used  two  distinct  cate¬ 
gories  in  their  classification:  preventive  and 
prepareduess  models  with  and  without  com¬ 
plete  information.  Valdez-Florez  and  Feld¬ 
man  (48)  presented  models  for  single-unit. 
Systems.  Very  recently,  Cho  and  parlar  (14) 
surveyed  literature  On  Optimal  maintenance 
models  for  multi-unit  systems. 

We  Start  this  survey  with  a  discussion  of 
Some  basic  characteristics  of  past  and  cur 
rent,  optimal  maintenance/replacement  mod¬ 
els  based  on  planning  time  horizon,  system 
State  transition  and  maintenance  criteria.  We 
then  briefly  discuss  individual  replacement 
papers  of  potential  interest  to  marine  indus¬ 
try. 


Basic  Characteristics 

Planning  time  horizon.  Replacement 
problems  may  have  a  finite,  infinite  or  ran¬ 
dom  time  horizon.  Finite  horizon  problems 
occur  when  a  SyStem  opertores  until  a  known 
termination  time.  For  finite  time  horizon 
problems,  the  objective  is  finding  the  policy 
that  will  maximize  the  expected  the  total  revenue 
(or  minimize  expected  total  cost)  generated 
by  the  system.  One  solution  approach  for  the 
finite  horizon  problem  is  referred  to  as  value 
iteration  (27).  The  objective  is  to  maximize 
average  revenue  per  unit  time  (which  is  re¬ 
ferred  tO  as  "gain")  when  no  discounting  is 
used,  or  to  maximize  the  expected  present 
value  of  future  rewards  in  the  case  of  dis¬ 
counting.  To  meet  either  objective,  the  policy 
iteration  method  is  used  (27). 

System  state  transition.  To  model  system 
state  transition  behavior,  many  existing  re¬ 
placement  models  assume  a  Markov  process 
(4,17,24).  Assuming  exponential  lifetimes 
(and  hence  constant  hazard  rates)  for  sys¬ 
tem  components,  these  models  ignore  the  ef¬ 
fects  of  aging.  However,  the  hazard  rate  of  a 
mechanical  componet  allmost  always  varies 
with  time.  Hence  the  Markovan  assumption 
is  not  very  realistic  for  many  mechanical  com¬ 
ponents.  To  iilfhk  the  effects  of  break-in 
failures  and/or  aging,  many  authors  (7,28) 
model  the  system  behavior  as  a  semi-Markov 
process  (embedded  Markov  process). 

Maintenance  criteria.  When  a  failure  oc¬ 
curs,  a  decision  maker  usually  has  the  "re¬ 
pair,”  "replace"  and  “do  nothing"  options. 
Mauy  existing  maintenance  models  assume 
that,  When  a  failure  occurs,  it.  is  best  to 
replace  the  failed  item,  completely  ignor¬ 
ing  repair  as  another  option  (5,8,12,28,46), 
whereas  some  models  also  consider  repair  as 
another  option  (49,37).  The  time  to  repair 
and  the  time  to  replace  are  also  considered 
in  Some  models:  While  many  models  assume 
instantencous  repair  and  replacement  times 
(10,36,33),  others  consider  repair  and  replace¬ 
ment  times  as  random  variables. 
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There  are  many  replacement  policies, 
such  as  the  Age  Replacement  Policy  (ARP) 
(21  ,10,50,33),  the  Modified  Age  Replacement 
Policy  (MARP)  for  intermittently  used  sys¬ 
tems  (36,7,8),  replacement  after  N  repairs  (or 
N  uses),  and  replacement  based  on  failure 
risk. 

Repairs  are  also  classified  as  minimal  and 
complete  repairs.  A  minimal  repair  returns 
the  failed  item  to  its  functioning  condition 
just  prior  to  failure,  whereas  complete  repair 
brings  the  failed  item  to  the  "as  good  as  new" 
condition  (9,45).  The  degree  of  repair  is  also 
integrated  into  some  models  (33). 

Selected  Models 

In  the  following.  Some  selected  papers 
on  system  maintenance  and  replacement  rel¬ 
evant  to  marine  maintenance  are  discussed. 
The  characteristics  of  models  in  terms  of  time 
horizon,  system  state  transition  and  maine- 
nance  criteria  are  examined. 

Kao  (28)  assumed  that  the  system  may  be' 
in  one  of  i  states  (i=0,l,2,...,L),  where 
state  0  corresponds  to  a  “brand-new”  Sys¬ 
tem,  state  L  corresponds  to  a  failed  system 
and  others  (i  =  1,  2,  .  .  .  ,  L  -  1)  correspond  to 
degraded  (imperfect  performance)  states.  He 
also  assumed  that  there  is  only  type  Of 
replacement,  and  treated  the  system  as  one 
component.  He  proposed  three  replacement, 
models,  using  the  policy  iteration  method  to 
minimize  expected  costs  per  unit  time,  un¬ 
der  three  rules;  replacement  based  on  system 
state,  replacement,  based  on  system  age  and 
replacement  based  on  both  system  state  and  be 
age. 

Mine  et  al.  (36)  considered  optimal  pre¬ 
ventive  replacement  for  intermittently  used 
systems  under  two  different  criteria:  1)  re¬ 
placement  after  N  USes,  assuming  time  du¬ 
rations  of  uses  to  be  random  variables;  and 
2)  replacement  when  Cumulative  operating 
age  reaches  a  specific,  time,  T,  before  failure. 
Their  objective  was  to  find  the  values  of  N 
and  T  that  minimize  the  mean  cost  rate  over 
an  infinite  time  horizon.. 


Berg  (8)  also  studied  preventive  replace¬ 
ment  policies  for  intermittently  used  units. 
He  considered  a  modified  age-replacement 
policy  (MARP)  under  which  the  unit  is  re¬ 
placed  preventively  When  its  age  exceeds  a 
critical  Operational  age.  Provided  that  re¬ 
placement  times  coincide  with  no-demand  pe¬ 
riods.  Otherwise,  preventive  replacement  is 
delayed  until  the  end  of  the  current,  demand 
period.  His  objective  was  to  minimize  the 
probability  that  the  unit  is  down  when  it.  is 
demanded. 

Thomas  (47)  developed  a  replacement 
model  assuming  that  both  the  system  (as  a 
framework,  like  the  body  of  a  car)  and  its 
components  (like  tires,  engine  etc,)  are  inde¬ 
pendent  of  each  other  and  can  be  replaced 
upon  failure  with  many  replacement  alter¬ 
natives.  He  ignored  preventive  maintenance 
completely.  Repairs  were  not.  allowed. 

WellS  (49)  examined  a  System  over  a  finite 
random  time  horizon  with  non-zero  repair 
and  replacement  times.  To  select  whether  to 
repair,  replace  or  ignore  a  failed  component, 
he  introduced  an  optimal  maintenance  policy 
(which  uses  policy  improvement,  and  linear 
programming  techniques).  He  assumed  that 
a  component  will  be  repaired  for  its  first.  N 
failures  before  ultimate  replacement.  He  also 
assumed  that  duration  of  the  System  mission 
(life  time  etc.)  is  a  ramdom  variable. 

Most  existing  existing  replacement  models  are  re¬ 
stricted  to  single  component  models  which 
can  not  be  applied  to  multi-component  SYS- 
tems  in  an  arbitrary  setting,  since  some 
policies,  as  control  limit  policies,  may  not. 
be  optimal  for  multi-component  systems. 
Most,  models  developed'  for  multi-component 
systems  assume  that  the  components  are 
stochastically  independent  of  each  other,  with 
increasing  failure  rate  (IFR)  lifetime  distribu¬ 
tions. 

ozekici  (-10)  studied  the  economic  de¬ 
pendence  between  system  components.  He 
particularly  focused  on  optimal  replacement 
policies  for  functioning  components  in  the 
presence  of  failed  components.  He  discussed 
the  stochastic  and  economic  dependencies 
among  system  components,  and  formulated  a 
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simple  path  analysis  of  the  reliability  system 
using  Markov  decision  theory. 

Boland  and  proschan  (11,12).  considered 
a  system  where  replacements  and  overhauls 
were  made  at  fixed  multiples  of  some  prede¬ 
termined  time,  T.  When  a  failure  occured, 
a  minimal  repair  was  performed.  They  cal¬ 
culated  the  period  that  minimized  the  total 
expected  cost  of  repair  and  replacement  cal- 
another  period  that  minimized  the  total  ex¬ 
pected  cost  per  unit  time  over  an  infinite  time 
horizon. 

Zuckerman  (51)  developed  a  maintenance 
strategy  to  optimize  long-run  average  cost 
and  total  expected  discounted  cost  over  an 
infinite  horizon.  The  system  was  subjected 
to  shocks  causing  a  random  amount  of  dam¬ 
age  to  the  system  components.  The  sys¬ 
tem  failed  when  failed  when  the  accumulated  damage  ex¬ 
ceeded  a  fixed  threshold.  For  the  optimal 
maintenance  policy,  the  diffusion  approxima- 

tion  model  was  Zuckermann  showed 

that  the  optimal  maintenance  expenditure 
rate  is  monotonically  increasing  in  the  cumn- 
lative  damage  level. 

Assaf  and  Shanthikumar  (4)  developed  op¬ 
timal  maintenance  policies  for  a  system  of 
N  machines.  Exponential  lifetimes  were  as¬ 
sumed,  with  the  same  Mean  Time  to  Fail¬ 
ure  (MTTF)  for  each  machine.  They  for¬ 
mulated  the  total  repair  cost  as  the  sum  of 
a  constant  which  reflected  the  overhead  cost 
of  repair  and  a  cost  of  repair  per  machine 
which  changed  linearly  with  the  number  of 
failed  machines.  Instantaneous  repairs  were 
assumed.  They  also  considered  a  second  type 
of  cost.  Which  incurred  due  to  machine  fail¬ 
ures  and  was  the  same  for  all  machines 
proportional  to  Time  to  Repair  (TTR).  They 
minimized  the  expected  cost  per  unit  time 
over  an  infinite  horizon,  and  showed  that  an 
optimal  policy  is  either  never  to  to  repair  or  to 
repair  all  failed  machines  as  soon  as  their 
number  exceeds  a  certain  threshold.  They 
also  assumed  that  the  number  of  failed  ma¬ 
chines  is  known  at  every  instant. 

Sethi  and  Chand  (44)  focused  on  plan¬ 
ning  horizon  results  for  the  replacement  prob¬ 
lem.  They  developed  three  machine  replace¬ 


ment  models  under  an  improving  technolog¬ 
ical  environment  over  time,  aiming  at  cost, 
ered  minimization,  profit  maximization,  and  cost 
minimization  with  stochastic  failures,  respec¬ 
tively. 

Oakford,  Fohmann,  and  Salazar  (39)  con¬ 
sidered  technological  improvement.  Their 
model  permitted  implemention  of  technologi¬ 
cal  improvement  in  a  flexible  manner  without 
reformulating  the  dynamic  program  for  each 
replacement  problem. 

Derman  and  smith  (15)  considered  a  sys¬ 
tem  which  should  operate  for  T  units  of  time, 
where  T  was  a  random  variable  with  a  known 
distribution  function  F.  It.  was  assumed  that  , 
when  a  vital  component  failed,  it  had  to  be 
replaced  with  a  new  component.  For  each 
component  there  were  n  possible  types  of  re¬ 
placements.  The  objective  was  to  choose  the 
type  that  minimized  the  expected  total  cost, 
of  providing  an  operative  component  for  the 
entire  life  of  the  system.  They  generalized  the 
results  of  earlier  work,  where  lifetimes  were 
assumed  to  be  exponentially  distributed,  en¬ 
abling  them  to  treat  components  with  in¬ 
creasing  failure  rates. 

Bryant  and  Murphy  (13)  considered  sys¬ 
tems  subject  to  both  repairable  and  non¬ 
repayable  failures.  They  considered  a  system 
which  was  subject  to  three  modes  of  failure. 
Type  I  failures  were  catastrophic  ones,  termi¬ 
nating  the  system's  life.  Type  II  failures  were 
the  ones  whose  damage  was  repairable  .  Type 
III  failures  were  non-repairable  and  resulted 
from  the  system's  aging.  They  also  consid¬ 
ered  non-zero  repair  times. 

Shaked  and  Shantikumar  (45)  studied  sys¬ 
tems  whose  components  have  dependent  life 
lengths  and  failed  components  are  imper¬ 
fectly  repaired  until  they  are  scrapped.  They 
developed  models  in  which  more  than  one 
component  can  fail  at  the  same  time. 

Numerous  investigators  developed  some 
complex  preventive  maintenance  models  for 
which  each  item  was  replaced  upon  upon  fail¬ 
ure,  and  all  identical  items  were  replaced 
at  multiples  of  some  period  T,  without,  con¬ 
sidering  the  ages  of  the  items  in  question 
(46,11,12,38). 
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Berg  (9)  constructed  an  age  replacement 
procedure  for  mi  ssi  on- cri  ti  cal  items  by  adopt  - 
i  ng  a  Bayesi  an  approach.  Hi  s  purpose  was  to 
ensure  that  the  system  is  capable  of  complet¬ 
ing  the  mi  ss  i  on  wi  t  hout  a  failure  by  control¬ 
ling  the  reliability  of  mission-critical  items. 
Berg  defined  p  as  the  probability  that  the 
item  wi  1 1  operate  failure-free  in  the  next  pe¬ 
riod  of  some  sped f i  ed  I  ength  I .  In  order  to  at.- 
tain  failure-free  operation,  he  suggested  that 
an  item  should  the  replaced  when  p  falls  be¬ 
low  some  specified  value,  He  combined 
two  uncer  t  ai  ni  t  i  es  associated  with  the  pro¬ 
cess,  namely  incomplete  knowledge  of  the 
item's  life  distribution,  (which  is  a  function 
Of  a  parameter,  I)  and  the  stochastic  be¬ 
havior  of  the  failure  process  given  I .  In  his 
model,  Berg  considered  a  replacement  crite- 
ri  on  whi  ch  was  based  on  f  ai  I  ure  risk. 

I  noz  0  and  Per  aki  s  (23.41)  studied  reliabil¬ 
ity  and  replacement  characteristics  of  Great 
Lakes  marine  diesel  engines.  A  Col  t  -  Pi  el  st  i  ck 
PC2  -  4  0  0  series  marine  diesel  engine  has  been 
used  as  a  prototype  for  the  mo d e I  i  n g .  The 
authors  developed  and  implemented  reliabil¬ 
ity  based  models  to  rationalize  current  winter 
layup  replacement  practices.  Two  systems 
have  been  considered:  one  for  a  ship  equipped 
with  one  engine  only  and  another  for  a  two- 
engine  ship.  Incorporating  the  age  depen¬ 
dent  nature  of  system  failure  characteristics, 
a  semi -Markov  compet  i  ng- process  approach 
has  been  used  in  their  models,  where  system 
failure  behavior  has  been  treated  as  a  race 
among  engine  components.  Howard's  one- 
set,  c  o  mp  e  t  i  n  g  process  model  has  been  i  m- 
plemented  and  extended  to  two  sets  of  com¬ 
peting  processes  ( 27) .  A  recursive  iteration 
procedure  has  been  used  in  the  expected  cost 
calculation.  Computer  codes  have  been  de¬ 
veloped  using  the  above  models,  and  several 
examples  have  been  examined.  Sensitivity 
analyses  have  been  p  e  r  f  o  r  me  d  for  several  p  a  - 
rameters  to  see  the  influence  of  their  v a i  ra¬ 
tion  on  the  expected  costs  and  corresponding 
winter  layup  policies. 

The  mo  d  e  I  s  discussed  above  ignored  the 
budget  constraints  usually  faced  in  imple¬ 
mentation.  In  the  following  section,  a  new  de¬ 


terministic  approach  which  explicitly  consid¬ 
ers  budget  constraints  Is  Introduced.  This  ap¬ 
proach  i  s  appl  i  cabl  e  to  ship  f  I  eet  mi  ntenance 
and  repl  acement .  In  addition,  the  same  same  ap¬ 
proach  i  s  equal  I  y  appl  i  cabl  e  to  mai  ntenance 
and  replacement  of  the  components  of  a  sin¬ 
gle  ship. 

CAPITAL  RATIONING 

Traditional  replacement  and  maintenance 
mo  d  e  I  s  usually  a  s  s  u  me  u  n  I  i  mi  t  e  d  capital  in 
practice,  however  deci  si  on  makers  frequently 
are  restricted  by  limited  maintenance  and  in¬ 
vestment  funds.  Under  capital  rationing,  the 
replacement  and  maintenance  decisions  must 
be  determined  simultaneously.  Due  to  the 
interdependence  of  decisions,  the  computa¬ 
tional  difficulty  Increases  significantly.  In  this 
section,  we  present  an  integer  programming 
model  and  discuss  a  Lagr  angi  an- based  solu¬ 
tion  me  t  h  o  d  o  I  o  g  y . 

The  following;  assumptions  characterize 
the  decision  environment. 

•  The  service  under  consideration  is  pro¬ 
vided  by  a  number  of  components,  each 
of  whi  ch  compet  es  for  a  fixed  budget  in 
each  period  for  maintenance  or  replace¬ 
ment. 

•  All  cash  f  I  ows  and  budgets  are  det  er  mi  n- 
istic,  i .  e. ,  they  are  known  wi  t  h  certainty 
at  the  time  of  the  analysis. 

•  Decision  maker's  objective  is  to  mini¬ 
mize  the  total  discounted  cost  of  replace¬ 
ments  and  ma j  o r  mai  ntenance  actions 
over  a  finite  planning  horizon. 

•  Maintenance  and  replacement  costs  are 
dependent  only  on  the  components's  age 
and  time  of  installation.  A  key  feature  of 
this  assumption  is  that  we  can  specify  fu¬ 
ture  costs  a  priori  using  ti  me- dependent 
"functional  relationships"  once  the  a  g  e  - 
dependent,  costs  of  current  components 
are  known.  Usual  I  y,  these  functional  re¬ 
lationships  reflect  the  decision  maker '  s 
estimates  of  technological  improvements 
and  inflation  for  future  components  (39). 
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1  Budgets  constraints  are  provisional  lim¬ 
itations  imposed  for  the  purpose  of  con¬ 
trolling  replacement  and  maintenance 
expenditures.  They  do  not  represent 
"hard"  bounds  in  the  sense  Of  an  abso¬ 
lute  limit  on  finance. 


Let  a  zero-one  Variable  X(c,a,i,j)  be  set 
to  one  if  action  a  is  taken  on  component  in 
period  j  and  doing  nothing  but  routine  main¬ 
tenance  until  period  .j;  X(c,a,i,j)  is  set  to 
zero  otherwise.  Actions  on  a  certain  compo¬ 
nent  can  be  replacing  it  with  a  new  one  as 
well  as  performing  a  major  maintenance  ac¬ 
tivity,  such  as  an  overhaul,  a  major  repair  and 
so  on.  Also  let 


planning  horizon, 
number  of  components, 
cost  Of  action  a  on  com¬ 
ponent  c  in  period  i, 
budget  in  period  i.  and 
discounted  cost 

of  keeping  component  c 
in  service  from  period  i 
to  period  j  after  taking 
action  a  in  period  i. 

Then,  flu*  problem  can  be  formulated  as 
an  integer  program  as  follows:  Mnimize 

YUl,  Yl  C(r' A 

r  a  i  j 

subject  to  the  following  constraints: 


II 

II 

P(c,a,i)  = 
B(i) 

C(c,a,i,j,)  = 


1.  Replacement  and  maintenance  actions 
must  be  sequenced  in  series  over  time 
on  each  component.  These  constraints 
are'  to  prevent  any  interruption  of  ser¬ 
vice.  For  each  c: 


yiy^V(r,  a,0J)  =  1 

«  j 


Y2  ^2  'V(r,  »,/,./)- 

«  j 

YT.Xlr,  a,j,i)  =  0 

«  j 

/  =  1 . H 

x[c,€tj,  h) = -i 

«  j 


2.  Expenditures  should  be  within  budgets. 

So,  for  i  =  0,..  .  .  H  -  1: 

y.  p(<\  a,  j)  y;  x  {<-, /,./)  <  n^) 

r  n  j 

3.  Integrality 

A’ (r,  a,  i,j)  £  {0,1}  V  r,  it,  i,j 

Solving  the  above  integer  program  would 
be  significantly  easier  if  the  replacement  and 
maintenance  decisions  of  individual  compo¬ 
nents  were  not  interdependent  by  the  capital 
rationing  constraints  (constraint  set  2  above). 
This  observation  suggests  a  Lagrangian  relax¬ 
ation  approach  in  which  the  capital  rationing 
constraints  are  dualized  up  into  the  objec¬ 
tive  function  with  fixed  multipliers.  Let.  /t(i) 
be  the  multiplier  associated  with  the  budget 
constraint  of  period  j.  Then,  the  Lagrangian 
problem  can  be  specified  as  follows: 


L{/i)  =  min 

r  a  i  j 

P{r,  a,  i)  //(/)]  X (r,  <i,  i,j)  -  ^  D{i)  /i(i) 

i 

subject  to  constraint  sets  1  and. 

Under  certain  conditions,  multipliers  can 
be  determined  SO  that  a  solution  of  the  La¬ 
grangian  problem  generates  an  optimum  so¬ 
lution  to  the  original  integer  program  satisfy¬ 
ing  the  budget  constraints  21).  However 
it,  is  also  likely  that  no  such  conditions  are 

satisfied  for  a  given  problem  data.  In  this 
case,  the  solution  of  the  Lagrangian  problem 
is  still  of  interest  for  two  reasons. 

1.  Given  the  assumption  that  the  capital 
rationing  constraints  are  imposed  pri¬ 
marily  for  expenditure  control  purposes, 
and  hence'  they  are  usually  not  binding 
to  the  extent  implied  in  the  problem  for¬ 
mulation,  the  Lagrangian  problem  may 
produce  acceptable  solutions. 
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2.  The  Lagrangian  problem  yields  lower 
bounds  (for  minimization  problems)  on 
the  optional  objective  of  the  original 
problem.  Therefore,  if  a  strict  optimum 
is  desired,  they  can  be  incorporated  into 
branch-and-bound  algorithms. 

With  Lagrangian  relaxation,  the  problem 
is  decomposed  into  n  Separate  and  inde¬ 
pendent  replacement-maintenance  problems, 
each  of  which  is  that  of  finding  a  shortest  path 
on  an  acyclic  graph.  We  use  a  dynamic  pro¬ 
gram  to  solve  efficiently  each  shortest  path 
problem.  For  a  given  //  >  0,  let. 

C ( c , a , i , j )  =  C(c,a,i,.j)  -  P(c,a,i)p(i) 

for  all  c,a,i,j.  Define  /( c,i)  as  the  dis¬ 
counted  cost  of  an  optimum  replacement  and 
maintenance  policy  over  a  planning  horizon 
i.  Initialize  /( c,0)  =  0  for  all  c.  For  each 
c,  the  following  recursive  equations  find  the 
shortest  path  from  period  0  to  H. 

/(r,./)  =  min  min  C'(r, a,  /,./)  +  f(<\  i) 

a  i ■  j 

for  j  =  1 . II.  At.  each  j,  store  the  mini¬ 

mizing  arguments: 

A(c,j)  =  argmin  /( c,j) 

c 

1(C) -j)  =  argmin  /( c,j) 
i 

The  optimum  solution  is  then  given  by  a 
dynamic  programming  tree  completely  speci¬ 
fied  by  A  and  I  on  the  acyclic  graph..  The  La¬ 
grangian  value,  which  is  a  lower  bound  on  the 
optimum  objective  of  the  original  integer  pro¬ 
gram,  is  the  sum  of  individual  shortest  paths 
minus  a  constant  term. 

L(l')  =  £/(<•.//)-  Y,  £(;)  /'(')• 

r  r 

Finding  the  best  multiplier  vector  so  that 
the  solution  Of  the  Lagrangian  problem  ap¬ 
proximates  the  solution  of  the  original  inte¬ 
ger  program  as  close  as  possible  is  a.  nondif- 
ferentiable  optimization  problem.  Basically, 
there  are'  two  approaches:  1)  Subgradient  ill- 
gorithins,  and  2)  multiplier  adjustment  meth¬ 
ods  (MAMs). 


Subgradient  algorithms  have  been  used  on 
many  practical  problems  Successfully.  Given 
an  initial  multiplier  vector,  its  basic  step 
requires  solving  the  Lagrangian  problem  to 
compute  a  subgradient  direction  for  the  mul¬ 
tipliers.  The  multipliers  are  them  changed  in 
the  computed  direction.  Details  of  subgradi¬ 
ent  algorithms  including  convergence  proper¬ 
ties  can  be  found  in  (25).  Held,  Wolfe  and 
Crowder  (26).  and  Goffin  (22).  Karabakal 
(31)  describes  a  sub  gradient  algorithm  for 
finding  the  best  multipliers  to  solve  the  above’ 
Larangian  relaxation  of  the  capital-rationed 
replacement  and  maintenance  problem. 

MAMs  are  heuristic  algorithms  for  deter¬ 
mining  best  multipliers  exploiting  the  special 
structure  of  a  particular  application.  The 
advantage  of  a  MAM  over  a  subgradient  al¬ 
gorithm  is  that  it.  usually  guarantees  mono¬ 
tonic  improvement  of  the  bound.  The  dis¬ 
advantages  are’  1)  it.  depends  on  a  specific 
problem  structure,  and  2)  it.  cannot  guarantee 
bounds  better  than  those  obtained  by  a  sub¬ 
gradient  algorithm.  Karabakal,  Lohmann, 
and  Beau  (32)  describe  an  efficient  MAM  for 
the  capital-rationed  replacement  and  main¬ 
tenance  problem  when  the  constraint  set 
rather  than  Set  2  is  relaxed.  They  also  discuss 
a  specific  branch-and-bound  technique  that 
uses  this  MAM  as  its  bounding  technique. 

An  Extension 

We  can  extend  the  above  formulation  to 
include  the  decision  situations  in  which  the 
maintenance  costs  are  dependent  on  the  con¬ 
dition  of  the  service  as  well  as  the  age  and 
time  of  installation  of  components.  Suppose 
the  conditions  represent  the  productivity  lev¬ 
els.  After  each  periodic  inspection,  assume 
a  component's  productivity  is  classified  into 
one  of  L  +  1  conditions.  It.  is  in  condition  0 
if  it.  is  least  costly  to  operate  in  condition  L 
if  it  is  most  costly  to  operate.  Then,  in  order 
to  compute  any  future  maintenance  we 
need  to  know  the  condition  of  the  service  at 
the  time  of  the  maintenance  action. 

We  assume  that  the  decision  maker  can 
make  deterministic  estimates  about  the  fu¬ 
ture  conditions  of  the  service  given  the  cur- 
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rent,  time  period,  condition  and  the  Iasi 

maintenance  action  taken.  Given  the  deter¬ 
ministic  deterioration  assumption  one  way 
of  formulating  the  problem  is  to  modify 
our  basic  formulation  to  incorporate  the 
condition-dependency  of  maintenance  costs. 
Let  X(c,a,i,i',j,j')j’)  be  set  to  one  if  action  a  is 
taken  on  component  c  in  period  i  at  condition 
i'  and  doing  nothing  but  routine  maintenance 
until  period  j  to  end  up  with  conditions  .j'. 
Redefine  C(c,a,i,i',j,j')  accordingly.  Then, 
we  wish  to  minimize 


EE EE E E  °lr' 

r  n  i  i‘  j  j’ 

*».«*  <  •*/*■/ 

A  (c, 


subject  to  the  following  constraints: 

1.  Replacement  and  maintenance  actions 
must  be  sequenced  in  series  over  time  on 
each  component.  For  each  c  and  i' 


r  II  r 


a"(c,  /.  /',  j. /)  <  B(i) 

J  j' 


where*  P(r,a.i,i')  is  t  he  cost  of  action  a 
on  component,  r  in  period  /  at  condition 


4.  Integrality 


X(c,a,  iJ\j,j')  G  {0,1}  V  c,«,  /, 

The  above  formulation  has  many  more 
variables  and  constraints  than  the  basic  for¬ 
mulation.  However,  the  structure  that  al¬ 
lows  us  to  develop  efficient  Lagrangian  re¬ 
laxation  techniques  for  the  basic  model  is 
still  there.  Again,  when  we  relax  the  budget 
constraints,  the  Lagrangian  problem  consists 
Of  many  shortest  path  problems  on  acyclic 
graphs.  Good  multipliers  can  be  determined 
using  a  MAM  similar  to  that  described  for 
the  basic  model. 


a  j  / 


E  E  E A  (r’ '* 

«  j  j' 
a  j  j' 

i  = 


-EEE  =  -i 

«  j  j' 

2.  In  each  period,  at  most  one’  maintenance 
Or  replacement  action  can  be  taken  over 
all  conditions,  SO  for  each  C  and  i: 


EEEE  «’ /f>  i'j')  ^ 1 


3.  Expenditures  should  be  within  budgets. 
So.  for  i  =  0,.  .  .  ,  H  -  1: 


CONCLUDING  REMARKS 

First.,  various  maintenance  and  replace¬ 
ment  models  with  applications  in  the  marine 
industry  are  discussed.  Second,  a  new  ap¬ 
proach  to  solve  the  multi-item  replacement 
under  budget  constraints  is  presented.  As  it, 
was  mentioned  above,  a  number  of  computer 
based  decision  support  systems  have  been  in¬ 
troduced  to  the  marine  industry.  However, 
each  of  these  systems  focuses  on  on  a  spe¬ 
cific  aspect  of  the  entire  ship  operation  and 
maintenance  On  the  other  hand,  effective 
maintenance  planning  of  a  ship  aims  at  min¬ 
imizing  failures,  equipment  downtime,  spare 
parts  inventory,  maintenance  costs  and  emer¬ 
gency  maintenance  simultaneosly  while  satis¬ 
fying  regulations  and  meeting  voyage  sched¬ 
ules  with  a  limited  crew  capability  and  under 
budget  constraints. 

Various  onboard  decision  systems  recom¬ 
mend  a  variety  of  maintenance  actions  con¬ 
suming  resources  at  different  levels  and  as¬ 
signing  different  replacement  (or  overhaul) 
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times  depending  on  the  user  selected  risk 
level.  On  the  other  hand,  the  ship  fleet  opera¬ 
tor  has  to  distribute  limited  resources  among 
the  ships  efficiently  so  that  the  overall  prof¬ 
itability  of  the  shipping  company  is  maxi¬ 
mized.  Hence  the  optimization  model  de¬ 
tailed  above  could  be  implemented  to  fleet, 
replacement  and  maintenance  as  well  as  to  re¬ 
placement  and  maintenance  of  a  single  ship, 
considering  different  options  under  budget 
constraints. 
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